Annotating imaged data product

ABSTRACT

The annotating product adapted for use with an information system and with an exhibit having a plurality of objects has an imager ( 11 ) which is signal connected to the information system ( 91 ) and has codes ( 31 ) representing ( 33 ) objects ( 81 ) from the plurality of objects, the imager detecting light ( 32 ) from several codes together and sending an indicate signal ( 12 ) which represents at least one of the several objects to the information system which then sends an annotate signal ( 22 ) to cause a display ( 21 ) to output data about objects represented by the indicate signal.

[0001] This application claims benefit of U.S. provisional application60/226,183 filed 18 Aug. 2000, U.S. provisional application 60/238,952filed 10 Oct. 2000, and U.S. provisional application 60/256,086 filed 15Dec. 2000.

[0002] The annotating product—which is used with an information systemand with objects—provides data about an object when the object isindicated via an imager which detects light from several coded datasources together.

[0003] The objects can be in various planned and unplanned arrangementssuch as exhibits of objects in a store window, in a store, in a gallery,and in a museum and such as objects everyday objects in private homesand in public places.

[0004]FIG. 1 schematically depicts the product.

[0005]FIG. 2 depicts an example of light from a coded data source.

[0006] The annotating product is adapted for use with an informationsystem and with a plurality of objects. The product comprises an imager11 which is signal connected to the information system 91; comprisescoded data sources 31 representing objects from the plurality of objects81, with light 32 from the plurality of coded data sources beingdetected by the imager; comprises an indicate signal 12 which indicatesvia the imager to the information system objects from the plurality ofobjects; and comprises an annotate signal 22 from the information systemwhich causes annotate data about the indicated objects to be madeavailable to a person via a display 21.

[0007] “Person” here, and throughout, can not only mean a naturalperson, but also can mean various entities which can be animate andinanimate and which can be self acting and can be externally motivated.

[0008] The imager 11 has a field of view extending along each of threeorthogonal axes. Several coded data sources—members of 31—from theplurality of coded data sources are spatially separated in the field ofview. The imager detects light—members of 32—from the several coded datasources together.

[0009] “Detects light” here and throughout means not only detecting thepresence of light but also means detecting the specific properties ofthe light—such as the color bands 43—which encode data so that theimager can output an indicate signal which represents the data.Detecting light from several data sources together distinguishes theimager from a bar code reader which can not detect light from severalspatially separated bar codes together.

[0010] Light—41 for example—from a first coded data source—a member of31—from the plurality of coded data sources represents a first object—amember of 81—from the several objects. A first indicate signal—acomponent of 12—is caused by the imager when light from the first codeddata source is selected by the imager. The first indicate signalrepresents the first object. The first indicate signal is output by theimager and is input to the information system. A person can cause lightfrom the first coded data source to be selected by the imager.

[0011] First annotate data associated with the first object is availableto the information system. The first indicate signal causes theinformation system to output a first annotate signal—a component of22—which represents the first annotate data. The first annotate signalis input to a display 21. The first annotate signal causes the displayto output the first annotate data. The display can be visible to aperson.

[0012] The imager can be a private imager. A plurality of object codeddata sources can member-by-member correspond to object members from theplurality of coded data sources as indicated by 33. The first coded datasource is a first object coded data source from the plurality of objectcoded data sources. Light from the first object coded data source iscaused to be selected by data input to the private imager to select arepresentation of the first object coded data source output by theprivate imager.

[0013] The private imager can be part of a device such as a cell phoneand a computer which can be signal connected to the information system.When the private imager detects light from the first object coded datasource, the private imager can output a representation of the firstobject coded data source. This representation can then be selected bythe person by any of various data input means such as key stroking,screen tapping, and computer mouse clicking.

[0014] The imager can be a public image. A plurality of person codeddata sources can member-by-member correspond to person members from theplurality of coded data sources. A first person coded data source fromthe plurality of person coded data sources is the first coded datasource. The first person coded data source is selected by the imagerwhen a first alignment—a component of 33—of the first person coded datasource is held for a set time.

[0015] In this public imager case the first person coded data source—41for example—can have a first axis 45—defined for example by bands 42 and44. The first alignment can be achieved by manipulating the first personcoded data source so that the first axis intersects the first object.The first alignment represents the first object by intersecting thefirst object.

[0016] In the public imager case a plurality of object coded datasources can also member-by-member correspond to object members from theplurality of coded data sources. The plurality of object coded datasources member-by-member separately represent—components of 33—eachobject from the plurality of objects.

[0017] In this case the public imager can also detect light from severalobject coded data sources representing the several objects. The indicatesignal can have an object component which represents the objects. Thus,even if objects have been moved—by forces which can be internal,external, and combinations thereof—the information system will have dataabout the first object when it is indicated by the first alignment.

[0018] In this case the first alignment can also be achieved bymanipulating the first person coded data source to indicate the firstobject coded data source representing the first object. The first objectcoded data source can be selected—for example—by obscuring at least partof at least one of the first person coded data source color bands 43.

[0019] The information system can be adapted so that more than one ofthese alignment means can be used. The information system can be adaptedso that the alignment means can be caused by various combinations of allof these alignment means.

[0020] In the private imager case many persons can be manipulatingprivate imagers. For example a first person can manipulate a firstprivate imager and cause a first indicate signal representing a firstobject while a second person can manipulate a second private imager andcause a second indicate signal representing a second object. The firstperson and the second person can cause a first indicate signal and asecond indicate signal which represents the same object which can be thefirst object and can be the second object.

[0021] The first indicate signal from the first private imager can havea first person component which represents the first private imager andthe second indicate signal from the second private imager can have asecond person component which represents the second private imager. Thefirst person component and the second person component can cause thefirst annotate signal and the second annotate signal here to have afirst personal component representing first annotate data relevantspecifically to the first person, and the second annotate signal to havea second personal component representing annotate data relevantspecifically to the second person.

[0022] In the public imager case many persons can be manipulating manyperson coded data sources. A first person coded data source beingaligned by a first person can have a portion—43 for example—whichrepresents the first person, and a second person coded data source beingaligned by a second person can have a similar, but distinct, portionwhich represents the second person.

[0023] The first indicate signal from the public imager can have a firstperson component which represents the first person and the secondindicate signal from the public imager can have a second personcomponent which represents the second person. The first person componentand the second person component can cause the first annotate signal andthe second annotate signal to have a first personal componentrepresenting first annotate data relevant specifically to the firstperson, and the second annotate signal to have a second personalcomponent representing annotate data relevant specifically to the secondperson.

[0024] The display can have any of various forms which can be signalconnected to the information system. The display can be a privatedisplay in the private imager case and in the public imager case. Aprivate display can be any of various devices such as a cell phone and acomputer. The display can be a public display in the public imager caseand in the private imager case. A public display can be a large displaywhich can be perceived by many persons. A large display can showannotate data intended for each of many persons. A public display can beprojected to a location close to a person so that this display can beperceived by the person and only also by other persons close to theperson.

[0025] The display can be various combinations of two and more of these.The display form can be tailored to the needs and wants of variouspersons indicating objects.

[0026] The display can be any data output means which can be perceivedby a person such as visual, audible, and tactile means. The display canbe combinations of these means. The display can be achieved by motionsof a robot. The data output means can be tailored to the needs and wantsof various persons indicating objects.

[0027] The indicate signal can have a query component. A query componentcan be caused by a person. Many query components can be caused by manypersons together. A query component can request various specific replydata about the indicated object such the query “what colors areavailable?” relevant to merchandise and such as queries relevant toother exhibits of objects. The first annotate data can have a replycomponent which represents the first reply data.

[0028] A query component can be caused by a person manipulating aprivate imager to detect light from object coded data source. When lightfrom the object coded data source is detected, the imager can give theperson the opportunity to cause a query component by any of various datainput means.

[0029] A query component can be caused by a person manipulating a personcoded data source so that light from the person coded data source isdetected by a public imager. The person coded data source can have aform like that depicted in FIG. 2 with color bands. Thus the querycomponent can be caused for example by obscuring at least part of atleast one of the person coded data source color bands.

[0030] The information system can be adapted so that more than one ofthese means can be used. The information system can be adapted so thatthe query component, and any second query component, can be caused byvarious combinations of these means.

[0031] When a person code has a component which identifies a person, aquery can be answered with annotate data about the object particularlyrelevant to the person.

[0032] The imager can be the dual mode imager of patent applicationPCTUS/01/13742 filed 30 Apr. 2001. The coded data source depicted inFIG. 2 is a form which works well with the dual mode imager. The bands42 and 44 retro reflect infra red light. The locate mode of the dualmode imager detects these bands. The react mode of the dual mode imagerdetects light from the region 43 over other light from the field ofview. Band 44 is wider than band 41 defining a direction. Other imagersand other forms of coded data sources can be used.

[0033] The imager—dual mode and otherwise—can have components separatedin space. This can enlarge the field of view. This can facilitatedetermining the spatial positions of coded data sources. The imager canhave several elements which selectively detect portions of a range ofvalues of a physical property of light from a coded data source, withthe several portions detected by the several imager elements beingcombined to detect the full range of the physical property of lightwithout forming an image of the coded data source.

[0034] Light from a coded data source can have various sources such aslight reflected from ambient sources; a coded data source light source;light emitted after energizing by suitable radiation; light emittedafter energizing by suitable radiation with a characteristic decay time;a light source adjacent to the imager illuminating the coded datasource; and combinations of two and more of these.

[0035] Light is not limited to visible light. For example, infrared canbe used, and millimeter and longer wavelengths can be used. Light can beradiating energy from any portion of the electromagnetic spectrum whichcan provide the functions required here. Other forms of radiatingenergy—such as acoustic energy—which can provide the functions requiredhere are included in the meaning of “light” here.

[0036] A “signal” from a first product part to a second product part anda first product part being “signal connected” with a second product parthere, and throughout, mean that a first physical state of the firstproduct part causes a second physical state of the second product part.This can occur by various direct causal means and can occur by any ofvarious transmission means. Transmitted signals can be any of variouspoint-to-point and broadcast forms of energy transmission such aswireless and via wires, cables, and fibers. Parts of transmitted signalscan reside with one form of the transmitted signal, parts can residewith a second form of transmitted signal, and parts can reside withvarious combinations of transmitted signals.

[0037] The several causes here can act via any of various processingmodes. The processing can utilize configured processing elements such asfixed circuits, can utilize configurable processing elements such asfield programmable gate arrays and neural networks, can utilizeinstructions in a data-bearing medium, and can utilize combinations ofthese. The processing be stand alone, can act via a local informationsystem, can act via a networked information system, and can act viacombinations of these. The processing—in part at least—can be a part ofthe imager.

Claimed is:
 1. An annotating product used with an information system andwith a plurality of objects, the product comprising: an imager, theimager having a field of view, the field of view extending along each ofthree orthogonal axes, a plurality of coded data sources, several codeddata sources from the plurality of coded data sources being spatiallyseparated in the field of view, light from the several coded datasources being together detected by the imager; a first object from theseveral objects; a first coded data source from the several coded datasources, light from the first coded data source representing the firstobject; a first indicate signal, the first indicate signal being causedwhen light from the first coded data source is caused to be selected atthe imager, the first indicate signal representing the first object, thefirst indicate signal being output by the imager, the first indicatesignal being input to the information system; first annotate dataassociated with the first object, the first annotate data beingavailable to the information system; a first annotate signal output bythe information system, the first annotate signal being caused by thefirst indicate signal, the first annotate signal representing the firstannotate data; and a display, the display receiving the first annotatesignal and the display being caused by the annotate signal to output thefirst annotate data.
 2. The product of claim 1 wherein: the imager is aprivate imager; a plurality of object coded data sourcesmember-by-member corresponds to object members from the plurality ofcoded data sources; the first coded data source is a first object codeddata source from the plurality if object coded data sources; and lightfrom the first object coded data source is caused to be selected by datainput to the private imager to select a representation of the firstobject coded data source.
 3. The product of claim 1 wherein: the imageris a public imager; a plurality of person coded data sourcesmember-by-member corresponds to person members from the plurality ofcoded data sources; the first coded data source is a first person codeddata source from the plurality of person coded data sources; and lightfrom the first person coded data source is caused to be selected at theimager when a first alignment of the first coded data source ismaintained for a set time, the first alignment representing the firstobject by intersecting the first object.
 4. The product of claim 3wherein: a plurality of object codes member-by-member corresponds toobject members from the plurality of coded data sources, the severalcoded data sources in the field of view comprises a first object codeddata source; the indicate signal has a first object component, and thefirst object component positionally represents the first object codeddata source.
 5. The product of claim 1 wherein the display is a privatedisplay.
 6. The product of claim 1 wherein the display is a publicdisplay.
 7. The product of claim 1 wherein the indicate signal has afirst query component which solicits first reply data about the firstobject and wherein the first annotate data has a first reply componentwhich represents the first reply data.
 8. An annotating product usedwith an information system and with a plurality of objects, the productcomprising: a private imager, the private imager having a field of view,the field of view extending along each of three orthogonal axes, aplurality of coded data sources; a plurality of object coded datasources member-by-member corresponding to the plurality of coded datasources; several object coded data sources from the plurality of objectcoded data sources being spatially separated in the field of view, lightfrom the several object coded data sources being together detected bythe private imager; a first object from the several objects; a firstobject coded data source from the several object coded data sources;light from the first object coded data source representing the firstobject; a first indicate signal, the first indicate signal being causedwhen light from the first object coded data source is caused to beselected by data input to the private imager to select a representationof the first object coded data source, the first indicate signalrepresenting the first object code, the first indicate signal beingoutput by the private imager, the first indicate signal being input tothe information system; first annotate data associated with the firstobject, the first annotate data being available to the informationsystem; a first annotate signal output by the information system, thefirst annotate signal being caused by the first indicate signal, thefirst annotate signal representing first annotate data; and a display,the display receiving the first annotate signal and the display beingcaused by the annotate signal to output the first annotate data.
 9. Theproduct of claim 8 wherein the display is a private display.
 10. Theproduct of claim 8 wherein the display is a public display.
 11. Theproduct of claim 8 wherein the indicate signal has a first querycomponent which solicits first reply data about the first object andwherein the first annotate data has a first reply component whichrepresents the first reply data.
 12. An annotating product used with aninformation system and with a plurality of objects, the productcomprising: a public imager, the public imager having a field of view,the field of view extending along each of three orthogonal axes, severalobjects from the plurality of objects being spatially separated in thefield of view; a plurality of coded data sources, several coded datasources from the plurality of coded data sources being spatiallyseparated in the field of view, light from the several coded datasources being together detected by the public imager; a plurality ofperson coded data sources member-by-member corresponding to personmembers from the plurality of coded data sources; the several coded datasources comprising several person coded data sources from the pluralityof person coded data sources; a first person coded data source from theseveral person coded data sources; a first object from the severalobjects; a first indicate signal, the first indicate signal being causedwhen light from the first person coded data source is caused to beselected at the imager by a first alignment of the first person codeddata source is maintained for a set time, the first alignmentrepresenting the first object by intersecting the first object, thefirst indicate signal representing the first object, the first indicatesignal being output by the public imager, the first indicate signalbeing input to the information system; first annotate data associatedwith the first object, the first annotate data being available to theinformation system; a first annotate signal output by the informationsystem, the first annotate signal being caused by the first indicatesignal, the first annotate signal representing first annotate data; anda display, the display receiving the first annotate signal and thedisplay being caused by the annotate signal to output the first annotatedata.
 13. The product of claim 12 wherein: a plurality of object codesmember-by-member corresponds to object members from the plurality ofcoded data sources, the several coded data sources further comprisesseveral object coded data sources from the plurality of object codeddata sources; the indicate signal has an object component, and theobject component positionally represents the several objects.
 14. Theproduct of claim 12 wherein the display is a private display.
 15. Theproduct of claim 12 wherein the display is a public display.
 16. Theproduct of claim 12 wherein the indicate signal has a first querycomponent which solicits first reply data about the first object andwherein the first annotate data has a first reply component whichrepresents the first reply data.
 17. An annotating product used with aninformation system and with a plurality of objects, the productcomprising: a public imager, the public imager having a field of view,the field of view extending along each of three orthogonal axes, severalobjects from the plurality of objects being spatially separated in thefield of view; a plurality of coded data sources, several coded datasources from the plurality of coded data sources being spatiallyseparated in the field of view, light from the several coded datasources being together detected by the public imager; a plurality ofperson coded data sources member-by-member corresponding to personmembers from the plurality of coded data sources; the several coded datasources comprising several person coded data sources from the pluralityof person coded data sources; a first person coded data source from theseveral person coded data sources; a first object from the severalobjects; a first indicate signal, the first indicate signal being causedwhen light from the first person coded data source is caused to beselected at the imager by a first alignment of the first person codeddata source is maintained for a set time, the first alignmentrepresenting the first object by intersecting the first object, thefirst indicate signal representing the first object, the first indicatesignal being output by the public imager, the first indicate signalbeing input to the information system; a plurality of object codesmember-by-member corresponding to object members from the plurality ofcoded data sources, the several coded data sources further comprisingseveral object coded data sources from the plurality of object codeddata sources; an object component of the indicate signal, the objectcomponent positionally representing the several objects. first annotatedata associated with the first object, the first annotate data beingavailable to the information system; a first annotate signal output bythe information system, the first annotate signal being caused by thefirst indicate signal, the first annotate signal representing firstannotate data; and a display, the display receiving the first annotatesignal, and the display being caused by the annotate signal to outputthe first annotate data.
 18. The product of claim 17 wherein the displayis a private display.
 19. The product of claim 17 wherein the display isa public display.
 20. The product of claim 17 wherein the indicatesignal has a first query component which solicits first reply data aboutthe first object and wherein the first annotate data has a first replycomponent which represents the first reply data.